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[57] ABSTRACT 

A video signal- compression system includes motion 
compensated predictive compression apparatus for 
compressing respective frames of video signal accord- 
ing to either intraframe processing or interframe pro- 
cessing on a block by block basis to generate blocks of 
compressed data and associated motion vectors. A com- 
pressed signal formatter arranges the blocks of com- 
pressed data and the associated motion vectors accord- 
ing to a desired signal protocol wherein motion vectors 
of interframe processed frames are associated with cor- 
responding blocks of compressed data and motion vec- 
tors of intraframe processed frames are associated with 
blocks substantially adjacent to corresponding blocks of 
compressed data. The motion vectors are included with 
intraframe compressed data to facilitate error conceal- 
ment at respective receiver apparatus. 
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predictive frames. As with intraframe coded frames the 
ERROR CONCEALMENT APPARATUS FOR macroblocks include quantization, address and type 

MPEG-LIKE VIDEO DATA information. 

SUN and ZEDEPSKI in U.S. patent application Ser. 
This invention relates to apparatus for providing 5 No. 08/017,455 filed Feb. 12, 1993 and entitled APPA- 
concealment of lost or corrupted video data in compres- RATUS FOR CONCEALING ERRORS IN A DIGI- 
sion systems using an MPEG-like signal protocol. TAL VIDEO PROCESSING SYSTEM (incorporated 

BACKGROUND OF THE INVENTION * n lt& entirety herein by reference) describe a method of 

concealing errors in video data which was compressed 
When referring to MPEG-like signal what is meant is 10 m MPEG-like format. In this system the MPEG-like 
a compressed video signal of the general hierarchical signal is arranged in transport packets for transmission, 
form established by the MPEG Video Committee for The transport packets include error codes for detecting 
^w^ 0 ^ ^Sanization for Standardization. loss or corruption of respective packets. Sun and Zdep- 

MPEG-like video compression cyclically provides ski describe processes for concealing the effects of the 
fields/frames of data compressed by either mtraframe 15 lost transport packets on reproduced images. These 
techniques i or ^interframe predictive techniques. Refer to processes include providing substitute compressed data 
which shows a pictorial representation of the ^ or providing substitute decompressed data depen- 
MPEG-uke axhng format The frame sequence is dent u £ n ^ f of compresse 5 data Iost or ^ 

m ^ Te?X ^ % ^ Z^J' ' ^ ™ rupted. Error concealment techniques set forth by Sun 

respechve frames mdicate the coding mode for the 20 ^ ^ ^ kdude ^ subs ^ on collocated blocks 
respective frame. The frame sequence is divided into „ f . tn VT , „ ^ 

groups of frames (GOF) each of which includes the wfoZ^^ ^ L° non-collocated 
same coding sequence. Each frame of coded data is ^ of d ^ m P^ oata denved from motion vec- 
divided mto shoes representing, for example, 16 image *?* f ™ m vemcaUy adjacent macroblocks and the use 
lines. Each slice is divided into macroblocks eachof 25 potion vectors from vertically adjacent macroblocks 
which represents, for example, a 16x16 matrix of pix- m f ?°??8 substitute compressed data for a lost macrob- 
els. Each macroblock consists of, for example, 6 blocks loc T k of r mterframe «»>P*»d data, 
including four blocks of information relating to lumi- Intraframe compressed data tends to be of greater 
nanee signal and two blocks of information relating to ^ interfram e compressed data in 

chrominance signal. The luminance and chrominance 30 re P roducm S compressed images because all frames in a 
information are coded separately and then combined for of frames de P end from or build on decom- 

transmission. The luminanee blocks include data relat- Pressed intraframe data. Ironically error concealment of 
ing to respective 8X8 matrices of pixels. Each chromi- intraframes is least effective because there is less variety 
nance block comprises an 8 X 8 matrix of data relating to of encoded data from which to select substitute data. In 
the entire 16x 16 matrix of pixels represented by the 35 particular, there are no motion vectors included within 
macroblock. tne intraframe coded information. As a result, substitute 

Blocks of data, encoded according to intraframe cod- blocks of interframe data are substantially relegated to 
ing (I frames), consist of matrices of Discrete Cosine bein S eitner ^ average gray value or collocated blocks 
Coefficients. That is, respective 8x8 blocks of pixels froni a P rior frame or interpolated blocks. If the blocks 
are subjected to a Discrete Cosine Transform (DCT) to 40 ^e collocated, moving image objects will create image 
provide coded signal. The coefficients are subjected to artifacts, alternatively if the substitute blocks are inter- 
adaptive quantization, and then are run-length and van- polated, these areas will suffer loss of detail, 
able-length encoded. Hence respective blocks of trans- SUMMARY OF THE INVENTION 

mitted data may include fewer than an 8x8 matrix of nummary ut iwn IN vtrs iion 

codewords. Macroblocks of intraframe encoded data, 45 The present invention is an MPEG-like compression 
will include, in addition to the DCT coefficients, infor- system including apparatus for compressing respective 
mation such as the level of quantization employed, a frames according to intraframe and interframe compres- 
macroblock address or location indicator, and a mac- si°n processes. Interframe compression apparatus is 
roblock type. utilized to generate motion vectors for intraframe corn- 

Blocks of data encoded according to P or B inter- 50 pressed frames. The intraframe compressed data is ar- 
frame coding also consist of matrices of Discrete Cosine ranged in blocks or macroblocks and the intraframe 
Coefficients. In this instance however the coefficients motion vectors associated with respective blocks or 
represent residues or differences between a predic- macroblocks are included in the coded signal of verti- 
ted8X8 pixel matrix and the actual 8x8 pixel matrix. cally adjacent blocks or macroblocks for transmission. 
These coefficients are subjected to quantization and 55 At the receiving end of such system, respective mo- 
run- and variable-length coding. In the frame sequence tion vectors contained in the coded blocks or macrob- 
I and P frames are designated anchor frames. Each P locks of the intraframe compressed data are extracted 
frame is predicted from the lastmost occurring anchor and stored. When blocks or macroblocks associated 
frame. Each B frame is predicted from one or both of with such motion vectors are subsequently received or 
the anchor frames between which it is disposed. The 60 should have been received and have been determined to 
predictive coding process involves generating displace- be lost or corrupted and uncorrectable, the associated 
ment vectors which indicate which block of an anchor motion vectors are accessed from storage and utilized to 
frame most closely matches the block of the predicted generate substitute data for the lost or corrupted blocks 
frame currently being coded. The pixel data of the or macroblocks. 

matched block in the anchor frame is subtracted, on a 65 _ 

pixel-by-pixel basis, from the block of the frame being BRIEF DESCRIPTION OF THE DRAWINGS 
encoded, to develop the residues. The transformed resi- FIG. 1 is a pictorial representation of signal layers of 
dues and the vectors comprise the coded data for the an MPEG-like compressed video signal 
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FIG. 2 is a block diagram of apparatus for compress- 
ing video signal to .provide a compressed video signal 
according to an MPEG-like protocol. 

FIG. 3 is a pictorial representation of an MPEG-like 
compressed video signal code sequence. 

FIG. 4 is a pictorial representation of a transport 
packet utilized for transmitting MPEG-like data. 

FIG. 5 is a block diagram of a portion of an MPEG- 
like signal decompressor including error concealment 
apparatus. 

DETAILED DESCRIPTION 

Apparatus for generating MPEG-like signal is shown 
in FIG. 2. MPEG-like processing apparatus nominally 



best match to blocks in the current frame. These morion 
vectors are applied to the formatter 25 wherein they are 
associated with their corresponding macroblocks in the 
MPEG-like code sequence. That is, each interframe 
5 coded macroblock of residue transform coefficients has 
a motion vector associated therewith to indicate to 
decoding apparatus the raster location which the de- 
coded macroblock values should represent. In the 
MPEG-like systems, as noted before, motion vectors 
10 are only generated for interframe compressed frames of 
video signal, and the motion vector generator 18 need 
not operate during intraframe compression. 

In the present system however, the motion vector 
generator is operated during intraframe compression to 
includes separate apparatus (at least in part) for com- 15 generate motion vectors for respective macroblocks of 



pressing luminanee and chrominance signal compo- 
nents. The luminanee component compression appara- 
tus is shown in the figure. However it is assumed that 
the formatter 25 receives compressed chrominance 



I frames to aid in error concealment processes at respec- 
tive receivers. The motion vector generator may oper- 
ate for I frames in the same manner it operates for P 
frames for example. The motion vectors generated for 



data, from parallel circuitry not shown, in order to 20 macroblocks of such I frames indicate macroblocks in a 



create macroblocks of both luminance and chrominance 
compressed data. Since this type of apparatus is gener- 
ally known to those skilled in the art of video signal 
compression, only a brief description will be provided. 

In FIG. 2, a video signal source 10 provides video 25 
signal to be compressed to one input of a subtraction 
circuit 11, and to a motion vector generator 18. Signal 
from a motion compensated predictor including ele- 



prior decoded anchor frame, stored for example in 
memory of the motion compensated predictor, which 
most closely matches each respective macroblock. 
However in this application of the motion vectors, the 
motion vectors are not coded within the macroblocks 
for which they were generated. Rather they are in- 
cluded within macroblocks which have a low probabil- 
ity of being lost or corrupted if the macroblock which it 
represents is lost or corrupted. Assume that horizon- 



ments 17 and 16, is applied to a second input of the 

subtraction circuit During intraframe compression The 30 tally adjacent macroblocks are included in the same 
predictor provides a zero value to the subtraction cir- transport packets, but vertically adjacent macroblocks 
cuit 11, and during interframe compression the predic- are not Hence, if a particular macroblock is lost, the 
tor provides values representing a prediction of the probability that a horizontally adjacent neighbor will 
current frame being compressed. Hence during intra- also be lost will be much higher than the probability 
frame compression the subtraction circuit 11 provides 35 that a vertically adjacent macroblock will also be lost. 



pixel values, and during interframe compression it pro- 
vides the differences between the pixel values of the 
current frame and the predicted frame, i.e., it provides 
residues. 

The values provided by the subtraction circuit 11 are 40 
provided to a discrete cosine transform, DCT, circuit 
12, which transforms the spatial domain signal to the 
frequency domain. Coefficients generated by the DCT 
are quantized in a quantizing apparatus 13 which effec- 
tively limits the dynamic range of respective ones of the 45 
coefficients. The quantized coefficients are then run 
length and variable length encoded in the element 22. 
The signal is thereafter applied to a formatter 24, which 
arranges the signal components according to the desired 
signal protocol e.g., the MPEG-like protocol. Note 50 
provision may be included to DPCM encode certain of 
the signal components such as the DC DCT coefficients 
and/or motion vectors. The MPEG-like signal is ap- 
plied to a transport processor wherein it is conditioned 
for transmission over non-noise free channels. The con- 55 
ditioned signal is coupled to a modem 27, or a storage 
medium (not shown) for transmission or storage. 

Signal from the quantizer 13 is applied to the serial 
combination of an inverse quantizer 14 and an inverse 



In this instance the motion vectors representing respec- 
tive macroblocks are coded within their vertically adja- 
cent macroblocks. This is illustrated pictorially in the 
expanded portion of the "FRAME i" in FIG. 1. Thus if 
a particular macroblock is lost in transmission, there is a 
high probability that its associated motion vector will 
survive and may be utilized to aid in error concealment. 

The motion vectors generated for I frames are ap- 
plied to the formatter 25 for inclusion with the remain- 
ing macroblock data. However since motion vectors of 
slice n are included with macroblock data of the verti- 
cally adjacent slice n— 1, the macroblock data of slice 
n— 1 must be delayed one slice interval. This delay is 
provided by the compensating delay element 23. In 
FIG. 2, macroblock data is applied to the formatter 25 
via a multiplexer 24 either directly from the run-length 
and variable encoder 22 or through the compensating 
delay 23. The multiplexer is conditioned to effect the 
direct connection during compression of P and B 
frames and to effect connection through the compensat- 
ing delay during compression of I frames. Actually the 
compensating delay 23 and multiplexer 24 included in 
FIG. 2 are only symbolic. The formatter 25 marshal is 
significant amounts of data which arrives sporadically 



DCT 15, which respectively perform the inverse func- 60 and thus requires storage memory to make respective 



tions of elements 13 and 12. The pixel values or residues 
generated by the inverse DCT are applied to the motion 
compensated predictor which develops a reconstruc- 
tion of, or a prediction of, the current frame. 

The morion vector generator 18 receives predicted 
frame data from the predictor 16, 17, and current frame 
data from the source 10, and generates vectors which 
identify blocks of the predicted frame which are the 



types of data concurrently available for appropriate 
sequencing. To effect the one slice delay of the macrob- 
lock data to place the I frame motion vectors of slice n 
into macroblocks of slice n — 1 merely requires increas- 
65 ing the size of such storage memory within the format- 
ter 25. 

The MPEG-like coded signal format is illustrated in 
FIG. 3. The MPEG hierarchical format includes a plu- 
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rality of layers each with respective header information. The macroblock pointer is used for segmented macrob- 

Nominally each header includes a start code, data re- lock or record header components, and points to the 

lated to the respective layer and provision for adding start of the next decodable component For example, if 

header extensions. The header information is required the particular transport packet includes macroblock 

for synchronization purposes in an MPEG systems en- 5 data associated with the end of slice n and the beginning 

vironment of slice n -f 1 , the data from slice n is placed adjacent the 

The coded output signal of the present system is transport header and the pointer indicates that the next . 

segmented in groups of fields/frames (GOF) illustrated decodable data is adjacent the transport header TH. 

by the row of boxes L2 (FIG. 3). Each GOF (L2) in- Conversely, if a record header RH is adjacent the TH, 
eludes a header followed by segments of picture data. 10 the first pointer indicates the byte position following the 

The GOF header includes data related to the horizontal record header RH. A zero valued macroblock pointer 

and vertical picture size, the aspect ratio, the field/- indicates that the transport packet has no macroblock 

frame rate, the bit rate, etc. entry point. 

The picture data (L3) corresponding to respective The transport packet may include none, one or more 
fieldVrrames includes a header followed by slice data 15 than one record header. A record header occurs at the 

(L4). The picture header includes a field/frame number beginning of each slice of macroblock data. No record 

and a picture code type. Each slice (L4) includes a headers are included in transport blocks that include 

header followed by a plurality of blocks of data MBi. only video data header information. The record header 

The slice header includes a group number and a quantj- (RH) pointer points to the byte position containing the 
zation parameter. 20 start of the first record header in the transport packet A 

Each block MBi (L5) represents a macroblock and zero valued RH pointer indicates that there are no re- 
includes a header followed by motion vectors and cord headers in the transport packet. If both the record 
coded coefficients. The MBi headers include a macrob- header pointer and the macroblock pointer are zero 
lock address, a macroblock type and a quantization valued, this state indicates that the transport packet 
parameter. The coded coefficients are illustrated in 25 includes only video data header information, 
layer L6. Note each macroblock is comprised of 6 The 18-bit identifier in the LP transport header iden- 
blocks, including four luminanee blocks, one U chromi- tifies the current frame type, the frame number (modulo 
nance block and one V chrominance block. 32), the current slice number, and the first macroblock 

The block coefficients are provided one block at a contained in the transport packet, 
time with the DCT, DC coefficient occurring first fol- 30 Following the transport header is either a record 
lowed by respective DCT AC coefficients in the order header, RH, or data. As indicated in FIG. 4 the record 
of their relative importance. An end of block code EOB header for the video data includes the following infor- 
ms appended at the end of each successively occurring mation: A 1-bit FLAG which indicates if a header ex- 
block of data. tension, EXTEND, is present Following the FLAG is 

The compressed video data form the formatter 25 is 35 an identifier IDENTITY, which indicates a) the field/- 
applied to a transport processor 26 which a) segments frame type I, B or P; b) a field/frame number (modulo 
the MPEG-like data into respective payload blocks b) 32) FRAME ID; and c) a slice number (modulo 64) 
extracts portions of the header information to form SLICE IDENTITY. Following the identifier the re- 
transport packet headers, c) concatenates the payload cord header includes a macroblock priority break point 
blocks and the transport packet headers to form inter- 40 indicator, PBP. The PBP indicates the codeword class, 
mediate transport packets, d) performs a parity or cyclic developed by the analyzer 152 of the priority selector, 
redundancy check on each intermediate transport for dividing the codewords between high and standard 
packet and appends the appropriate parity check bits priority channels (when used). Lastly, an optional 
thereto to form respective transport packets, and c) may header extension may be included in the HP record 
multiplex transport packets of associated auxiliary data 45 header. 

with the transport packets of video data. The parity Each transport packet is terminated with a 16-bit 

check bits are utilized by the receiver for isolating er- frame check sequence, FCS, which is calculated over 

rors in conjunction with synchronizing header infonna- all bits in the transport packet The FCS may be gener- 

tion and for providing error concealment in the event of ated using a cyclic redundancy code, 
uncorrectable bit errors in the received data. 50 A more detailed description of exemplary transport " 

FIG. 4 illustrates the format of the signal provided by processing apparatus may be found in U.S. Pat No. 

the transport processor. Respective transport packets 5,122,875. 

may include more or less than a slice of data. Thus a The transport packets of information are applied to a 
particular transport packet may include data from the forward error encoding elements which a) perform 
endofoneshecanddatarrommebemnningofthenext 55 REED SOLOMON forward error correction encod- 
subsequent slice. Transport packets including video ing b) interleave blocks of data to preclude large error 
data may be interleaved with transport packets contain- bursts from corrupting a large contiguous area of a 
ing other data, e.g., audio. Each transport packet in- reproduced image; and c) appends, e.g., Barker codes to 
eludes a service type header ST which indicates the the data for synchronizing the data stream at the re- 
type of information included in the respective transport 60 ceiver. 

packet In this example the ST header is an 8-bit word At a receiver the transmitted or stored compressed 
which indicates whether the data is high or standard signal is detected, passed through a REED SOLOMON 
priority, and whether the information is audio, video or error corrector and applied via a rate buffer to a re- 
auxiliary data. ceiver transport processor 100. The data is applied to a 
Each transport packet includes a transport header 65 one packet delay element 50 and to an error detector 5Z 
TH immediately following the service header. The The error detector is responsive to the FCS error code 
transport header includes a 7-bit macroblock pointer, an within respective transport packets to determine 
18-bit identifier and a 7-bit record header (RH) pointer. whether any errors survived the REED SOLOMON 
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error correction, and if so to generate an error indica- in one (forward) or both (forward and backward) of the 

tion E which is coupled to one input of a demultiplexer buffer memories 314 and 316. The predictor provides a 

56. The delay element compensates for the time re- block of data (from the one of the buffer memories) or 

quired to perform this error check. The delayed trans- an interpolated block of data (derived from respective 

port packet is applied to a second input of the demulu- 5 blocks from both buffer memories) to a second input of 

plexer 56 and to a service detector 54. The service de- the adder 312. 

tector examines the service code in the transport header Decompression is performed as follows. If a field/- 

to determine whether the transport packet is of the type frame of input video data is intraframe encoded the 

to be serviced by the respective receiver, and if so what motion vectors associated with respective macroblocks 

type of data the payload contains. Responsive to the 10 are stored in the memory 66 for use by the error token 

service information the service detector generates a generator 65, and the decoded or inverse transformed 

service control signal S to condition the demultiplexer DCT coefficients which correspond to blocks of pixel 

to route the data and error signal to the appropriate values are applied to the inverse DCT element 310 via 

decoder e.g., audio (not shown), video, etc. the decoder 308. For intraframe encoded data the pre- 

The video data provided by the demultiplexer 56 is 15 dictor 304 applies a zero value to the adder 312 and the 

applied to an element 58 which is responsive to the inverse transformed DCT coefficients are passed unal- 

error signal to excise transport packets containing er- tered by the adder 312, to the video display RAM 

rors that were not corrected by the REED SOLOMON where they are stored for readout according to normal 

error correction. Transport packets which contain no raster scanning. The decoded pixel values are also 

errors are separated into transport header data and the 20 stored in one of the buffer memories 314 and 316 for use 

transport packet payload. The payload (DATA) is cou- in forming predicted image values for decoding motion 

pled to a variable length decoder VLD 64. The trans- compensated frames (B or P). 

port header data is arranged for utilization by an error If a field/frame of input data corresponds to a for- 
token generator 65, the system controller 370 and/or ward motion compensated P field/frame, the inverse 
VLD 64 . For the most part, the MPEG-like data is 25 transformed coefficients correspond to residues or dif- 
variable length encoded and thus a variable length de- ferences between the present field/frame and the last- 
coder is required to decode the video data. Variable most occurring I frame. The predictor 304, responsive 
length decoders are well known and are essentially state to the decoded motion vectors accesses the correspond- 
machines which route variable length codewords to ing block of I frame data stored in either buffer memory 
different ones of a plurality of decoding tables. The 30 314 or 316 and provides this block of data to the adder 
particular table used for a particular codeword is depen- wherein respective blocks of residues provided by the 
dent upon the type of data the codeword represents. inverse DCT circuit 310 are added to the corresponding 
Nominally, in an error free environment, a VLD will block of pixel data provided by the predictor 304. The 
obtain all necessary data to perform decoding from the sums generated by the adder 312 correspond to the pixel 
input data stream. However when segments of data are 35 values for the respective blocks of the P Field/frame, 
lost, such a VLD may lock up or take an inordinate time which pixel values are applied to the display RAM 318 
to resynchronize. The transport header data is applied to update respective storage locations. In addition the 
to the VLD 64 along with the error signal, such that the pixel values provided by the adder 312 are stored in the 
VLD state machine is reset to the appropriate decoding one of buffer memories 314 and 316 not storing the I 
state on the resumption of good data. Alternatively, 40 field/frame of pixel data utilized to generate the pre- 
after loss of data the state of the VLD may be re-estab- dieted pixel data. 

lished by control signals from the system controller 370 For bidirectionally encoded (B) field/frames the op- 

in response to transport header and error data. eration is similar, except predicted values are accessed 

In an error free environment, variable length de- from the stored anchor frames (I or P) in both buffer 

coded signal from the VLD are applied to the system 45 memories 314 and 316 depending upon whether the 

controller and decompression controller 360 which respective motion vectors are forward or backward 

extract the MPEG-like header data to control the over- vectors or both. The generated B field/frame pixel 

all decoding sequencing. The variable length decoded values are applied to update the display RAM 318, but 

codewords corresponding to DCT coefficients are ex- are not stored in either of the buffer memories, as B 

tracted and applied to a decoder 308 and the variable 50 field/frame data is not utilized for generating other 

length decoded codewords corresponding to motion Field/frames of picture data. 

vectors are applied to the decoder 306. The decoder 308 The MPEG-like signal format allows the encoding of 

contains apparatus for performing inverse run length some macroblocks to be skipped For macroblocks that 

decoding and inverse DPCM coding as appropriate are skipped, the decoder effectively copies them from 

under the control of the controller 360. Decoded data 55 the previous picture into the present picture, or alterna- 

from the decoder 308 are applied to an inverse DCT tively, for skipped macroblocks the corresponding areas 

circuit 310 which includes circuitry to inverse quantize of the video display RAM 318 simply are not updated, 

the respective DCT coefficients and to convert the Macroblock skipping may be accomplished by coding 

coefficients to a matrix of pixel data. The pixel data is the motion vectors with zero values and the DCT coef- 

then coupled to one input of an adder 312, the output of 60 Ficients with all zero values. This feature of the decoder 

which is coupled to the video display RAM 318 and may be utilized to effect error concealment for lost 

buffer memories 314 and 316. macroblocks, simply by synthesizing the appropriate 

The decoder 306 includes circuitry to perform in- compressed codewords for skipped macroblocks on the 

verse DPCM coding of the motion vectors as appropri- occurrence of lost macroblocks. 

ate under the control of the controller 360. Decoded 65 Next, let us consider an environment in which errors 

motion vectors are applied to a motion compensated occur and transport packets are excised from the data 

predictor 304. Responsive to the motion vectors the stream applied to the VLD. Error concealment is the 

predictor accesses corresponding blocks of pixels stored responsibility of the error token generator 65. The error 
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token generator is, for example, a microprocessor Alternatively substitute data may comprise the mac- 

which is programmed to respond to the header informa- roblock address, the macroblock type, DC DCT coeffi- 

tion included in the transport blocks, the state of the cients corresponding to a midgray value for respective 

VLD and to the error indications. The error token blocks in the macroblocks and EOB codes for respec- 

generator 65 may include a table of substitute data 5 tive blocks in the macroblock. In this instance the corre- 

which simulates compressed video data. This data cor- spending image area will be reproduced with a midgray 

responds to particular data that is recognizable by the brightness value. 

MPEG-like decompressor. The error token generator is Availability of motion vectors in the P and B frames 

also provided with data from the memory 66 which provides added flexibility. Substitute macroblocks in 

may be substituted for excised video data. In particular, 10 compressed form may be composed of motion vectors 

the memory 66, responsive to the state sequencer of the stored in the memory 66 and selected from vertically 

VLD, is loaded with motion vectors corresponding to, adjacent macroblocks, and an indication that the cur- 

for example, the motion vectors of macroblocks in the rent macroblock was not coded, which means that all of 

previous slice of data. the residue values are considered to be zero valued. In 

The motion of image objects will occur across mac- 15 this instance the area of the image corresponding to the 

roblock boundaries. In addition errors will propagate or lost macroblock will likely be moving in synchronism 

occur along the horizontal direction. Thus it is likely with the remainder of the image, however the actual 

that motion vectors for P and B encoded frames from picture detail of this area may be slightly in error, 

vertically adjacent macroblocks will be similar, and the Consider that the DC DCT coefficients of respective 

substitution of motion vectors from vertically adjacent 20 blocks may be differentially encoded (DCPM) from 

macroblocks will result in acceptable error conceal- macroblock to macroblock. In this ca se the last macrob- 

ment. The motion vectors from vertically adjacent mac- lock of a sequence of substitute macroblocks will not 

roblocks of I encoded frames are precisely the requisite have a correct DC DCT value for the first non substi- 

motion vectors to use in securing substitute data for lost tuted macroblock to reference. The error token genera- 

I frame macroblocks. Similarly the DC DCT coeffici- 25 tor may include facility to substitute a DC DCT coefTi- 

ents from vertically adjacent blocks can be expected to cient in such last substitute macroblocks from a verti- 

be similar. As such they may also be stored in the mem- cally adjacent macroblock (i.e., taken from memory 66) 

ory 66 for substitution of lost DC coefficients. or from a temporally displaced collocated macroblock 

Storage of data in the memory 66 is controlled by the (taken from an expanded memory 66 arranged to store 

state sequencer within the VLD. The sequencer is pro- 30 select compressed data for e.g. an entire frame), 

grammed to condition the VLD to output data accord- Providing substitute data for I frames may be done in 

ing to a predetermined sequence, and thus can provide similar fashion, however since I frames are anchors for 

the appropriate signals to fetch the desired types of data an entire group of frames, substitute data should be in 

when it is output from the VLD. This data may be compressed form so that the results are reflected in the 

written into the memory at predetermined address loca- 35 prediction data stored in the memories 314, 316. Also 

tions which may be accessed by the error token genera- note that compressed I frame data comprises pixel value 

tor- DCT coefficients, not residue coefficients, and in nor- 

The error token generator monitors the transport mal operation, when I frame data is being decoded, the 

header data and the error signal to determine when and motion compensated predictor is nominally conditioned 

what data is lost, and responsive to lost data, substitutes 40 to provides a zero value to the adder 312. Thus if a 

data on a macroblock basis. Sequences of predeter- substitute I frame macroblock is formed of a motion 

mined types of data are preprogrammed for substitution vector and zero valued coefficients, without more, the 

depending on the frame type and the type of data that is inverse DCT element 310 and the predictor 304 both 

lost For example, macroblocks carry particular ad- will provide zero values to the adder 312 for the substi- 

dresses and occur in a predetermined sequence. The 45 tute macroblock with the result that the reproduced 

error token generator, responsive to the header data image area will be black. This problem is overcome by 

determines if there is a break in the normal sequence of overriding the normal decompression algorithm via the 

macroblocks and provides substitute macroblocks for control bus interconnecting the error token generator 

missing macroblocks. The substitute data may be in the with the predictor. On the substitution of an I frame 

form of synthesized compressed data, in which case it is 50 macroblock with a synthesized macroblock including 

substituted into the compressed data stream by the mul- compressed vertically adjacent motion vectors and zero 

tiplexer 67 in place of the lost macroblock, or the substi- valued coefficients or EOB code, the inverse DCT 

tute data may be in the form of, for example spatially element will pass zero values but the predictor 304 is 

collocated temporally delayed image data, in which conditioned by the error token generator to pass the 

case it is provided by simple management of the display 55 predicted image values selected by the motion vectors. 

RAM. These values will pass through the adder 312 to the 

Examples of substitution data provided by the error display RAM and to the corresponding macroblock 

token generator will now be considered. The type of area in the appropriate buffer memory 314, or 316. The 

substitution data is dependent upon the type of frame reproduced substitute image area may not be exactly 

currently being processed and where in the data stream 60 correct since residues were not included to provide 

the error occurred. The simplest form of substitute data correction to the prediction values, however for most 

may consist simply of data indicating that a particular images of low to moderate detail the results will be 

macroblock was not coded. This data is substituted in substantially exact and in general conformity with local 

compressed form with the result that the decompression motion. 

algorithm will replace the corresponding image area 65 Further adjuncts to error concealment may be pro- 

with collocated data from the previous frame. In actual- vided by the error token generator as desired. For a 

ity the decompression process simply does not update review of some of these adjuncts the reader is invited to 

the corresponding image area in the display RAM 318. consult U.S. patent application Ser. No. 08/017,455. 
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What is claimed is: 

1. Apparatus for compressing video data comprising: 
a source of video signal to be compressed; 
motion compensated predictive compression means 
for compressing respective frames of said video 
signal according to either intraframe processing or 
interflame processing and on a block by block basis 
to generate blocks of compressed data correspond- 
ing to respective image areas, said motion compen- 



carded by said means for detecting errors, said 
synthesized data formed using intraframe motion 
vectors corresponding to said discarded blocks, 
which said motion vectors are accessed from said 
memory; and 

means for substituting said blocks of synthesized data 
for corresponding said discarded blocks of intra- 
frame compressed data. 

5. The apparatus set forth in claim 4- wherein said 



sated predictive compression means including 10 decompression means includes: 



means for providing interframe motion vectors 
MV/for blocks B/ of both intraframe and interflame 
processed video signal, said motion vectors MV/ 
relating respective blocks of predicted video signal 
to blocks of original video signal which are sub- 15 
stantially similar, and 
formatting means for arranging said blocks of com- 
pressed data and associated said motion vectors 
according to a desired signal protocol, wherein 
said interframe motion vectors MV/for blocks B/of 20 
said interframe processed video signal are attached 
to blocks B r - of interframe compressed data to 
which they relate and said interframe motion vec- 
tors MV, for blocks Bjof said intraframe processed 
video signal are attached to blocks Bjtof intraframe 25 
compressed data different than blocks B,of intra- 
frame compressed data to which the respective 
interframe motion vectors relate, where index k is 
not equal to index i. 

2. The apparatus set forth in claim 1 wherein said 30 
motion vectors corresponding to respective said intra- 
frame processed blocks are attached to vertically adja- 
cent blocks of compressed data. 

3. The apparatus set forth in claim 1 wherein said 
motion compensated compression means includes 35 
means for providing blocks of transformed pixel values 
for said intraframe processed video signal and for pro- 
viding blocks of transformed residues for said inter- 
frame processed video signal, wherein said residues 



inverse transform means having an input port cou- 
pled to receive said blocks of compressed data, and 
having an output port for providing blocks of in- 
verse transformed data; 
an adder having a first input port coupled to the 
output port of said inverse transform means, having 
an output port at which decompressed signal is 
available and having a second input port; 
a motion compensated predictive decompressor cou- 
pled to the output port of said adder and responsive 
to said decompressed signal and said motion vec- 
tors for generating at an output port of said motion 
compensated predictive decompressor, blocks of 
data corresponding to predicted frames of said 
video signal; and 
means for coupling the output of said motion com- 
pensated predictive decompressor to the second 
input port of said adder when said interframe pro- 
cessed data is being decompressed, and for nor- 
mally applying a zero value to the second input 
port of said adder when said intraframe processed 
data is being decompressed, and for concurrently 
coupling said motion compensated predictive 
decompressor to the second input port of said 
adder and applying a zero value to the first input 
port of said adder to provide decompressed data 
for discarded blocks of intraframe data. 
6. Apparatus for processing motion compensated 
compressed video data wherein ones of frames of video 



correspond to respective differences between predicted 40 signal are compressed according to intraframe process- 
pixel values and original pixel values. ing and other frames of said video signal are compressed 
4. Apparatus for processing motion compensated according to interframe processing, and wherein said 
compressed video data wherein ones of frames of video intraframe and interframe processing generates corn- 
signal are compressed according to intraframe process- pressed data on a block by block basis, and wherein 
ing and other frames of said video signal are compressed 45 motion vectors, MV in/ro / mmc , are generated for respec- 
according to interframe processing, and wherein said tive blocks of intraframe processed data, and respective 
intraframe and interframe processing generates com- motion vectors, MV^rra/rom* of intraframe processed 
pressed data on a block by block basis, and wherein blocks are attached to blocks of data other than blocks 
motion vectors are generated for respective blocks of to which they respectively correspond, said apparatus 
intraframe processed data, and respective motion vec- 50 comprising: 



tors of intraframe processed blocks are attached to 
blocks of data other than blocks to which they respec- 
tively correspond, said apparatus comprising: 
a source of said motion compensated compressed 
video data; 

means for detecting errors in said motion compen- 
sated compressed video data and for discarding 
blocks of data including errors; 

means for separating said motion vectors from re- 
spective blocks of intraframe compressed data, and 
for storing said motion vectors in memory, and for 
applying blocks of intraframe compressed data 
without corresponding intraframe motion vectors 
to decompression means for decompression; 

means, responsive to said motion compensated com- 
pressed video data and said means for detecting 
errors, for providing blocks of synthesized data for 
said blocks of intraframe compressed data dis- 



a source of said motion compensated compressed 
video data; 

means for detecting errors in said motion compen- 
sated compressed video data and for discarding 

55 blocks of data including errors; 

means for separating motion vectors, MV^/ raraft 
from said respective blocks of intraframe com- 
pressed data, for storing said motion vectors, MV ( - n 
tmframe, in memory, and for normally applying 

60 blocks of intraframe compressed data, without said 
motion vectors, MV introframe> to decompression 
means for decompression; 
means, responsive to said means for detecting errors, 
and stored motion vectors, MV/ flW / rflffl6 in said 

65 memory, for generating substitute blocks of image 
data for discarded blocks of intraframe compressed 
data. 
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